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1.  Introduction 


In  recent  years,  there  have  been  constructed  or  proposed  space  sensor  networks  [Anderson  et  al 
2002;  Barnhart  et  ah  2007a,  2007b;  Barnhart,  2008;  Barnhart  et  al,  2009;  Vladimirova  et  al 
201 1;  Dyrud  et  al,  2013]  designed  to  cover  selected  orbits  in  LEO  with  either: 

i)  low-cost  redundant  “disposable”  spacecraft-as-sensor  platforms  of  CubeSat  3U  size  or 
smaller,  or 

ii)  low-cost  low-SWAP  (Size.  Weight  and  Power)  sensors  designed  to  be  placed  on  as  many 
conventional  (ESPA-dass  or  larger)  satellites  as  possible. 

The  science  objective  of  these  missions  is  to  provide  a  dense  set  of  sensor  data  parameters  to  “fill 
in  the  gaps”  of  the  relatively  sparse  coverage  afforded  by  conventional  multi  -m  ill  ion-do  liar 
missions  |  de  la  Beaujardiere ,  2004]  which  produce  single-point  in-si  tu  or  remote  measurements. 

Despite  the  lower  cost  of  small  satellites  andlow-SWAP  instrumentation,  limitations  include 
funding,  choice  of  orbital  parameters  in  launch  opportunities,  space  debris  mitigation,  and  data 
volume/bandwidth  consideration.  A  key  question  asked  by  funders  and  approvers  is  still  “how 
many  satellites/sensors  are  enough?”  What  has  become  apparent  is  that  there  is  no  generally 
agreed  metric  for  determining  the  scientific  justification  side  of  this  argument,  and  wfe  propose 
one  methodology  to  obtain  quantitative  metrics  which  may  assist  in  answering  that  question. 


2.  Scientific  Problem  and  Background 
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The  science  problem  that  we  identify  for  this  study  is  space  weather  forecasting,  particularly 
forecasting  of  plasma  irregularities  (“plasma  bubbles'’)  that  cause  radio  and  GPS  scintillation. 
Such  scintillation  can  cause  loss  of  GPS  lock  (less  than  50%  availability  for  LPV-20Q  during 
severe  scintillation  [Seo,  2010]).  loss  of  com  muni  cations,  and  image  defocussing  in  synthetic 
aperture  radar.  Forecasting  (and  nowcasting)  ionospheric  conditions  conducive  to  plasma  bubble 
formation  would  seem  to  require  global  assimilative  models  of  the  ionosphere  to  provide 
baseline  conditions  in  the  regions  of  interest. 

Our  ability  to  specify  and  forecast  ionospheric  dynamics  and  ionospheric  weather  at  low  and  mid 
latitudes  is  strongly  limited  by  our  current  understanding  of  the  coupling  processes  in  the 
ion o sphere- thermosphere  system  and  the  coupling  between  the  high  and  low  latitude  regions. 
Furthermore,  only  a  limited  number  of  observations  are  available  for  a  specification  of 
ionospheric  dynamics  and  ionospheric  weather  at  these  latitudes.  As  shown  by  meteorologists 
and  oceanographers,  the  best  specification  and  weather  models  are  physics-based  data 
assimilation  models  that  combine  the  observational  data  with  our  understanding  of  the  physics  of 
the  environment  {Oaky,  1991].  Through  simulation  experiments  these  models  can  also  be  used 
to  study  the  sensitivity  of  the  specification  accuracy  on  different  arrangements  of  observation 
platforms  and  observation  geometries  and  can  provide  important  information  for  the  planning  of 
future  missions.  For  example,  these  studies  can  provide  information  about  the  number  of 
spacecraft  needed  to  improve  the  specification  or  evaluate  the  impact  of  different  observation 
geometries  on  the  accuracy  of  the  specification. 


3,  Instrument  and  Satellite  Concept 
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Previous  efforts  in  flying  iovv-cost  space  weather  instruments  have  focused  on  low-impact 
secondary  payloads  riding  on  larger  (e,g  ESP  A-c  lass)  satellites.  These  have  advantages,  in  that 
the  larger  satellites  tend  to  be  more  reliable  (through  extensive  heritage  and  testing)  and  have 
larger  link  budgets  and  power  margins.  However,  there  are  higher  integration  costs  (particularly 
when  co-riding  with  high-value  primary  payloads),  longer  project  timescales,  and  more 
expensive  busses  ($I0M+).  They  also  provide  only  a  few  in- situ  measurements  for  each 
satellite,  and  have  relatively  long  delays  before  resampling  the  same  dataspace* 

There  have,  however,  been  recent  advances  in  thinking  regarding  multiple  low-cost  redundant 
satellites  carrying  low-cost  sensors,.  Such  a  large  constellation  has  many  applications;  treaty 
sentinels,  disaster  monitoring,  magnetospheric  observations,  solar  wind  measurements,  pollution 
monitoring  and  communications  research  to  name  but  a  few.  In  many  of  the  above  cases  we 
currently  undersample  the  data  field.  We  concentrate  our  approach  for  this  paper  on  the 
thermo  sphere/ionosphere  system,  ingesting  plasma  density  and  temperature  data  from  in-situ 
measurements  into  an  assimilative  model  although  the  general  methodology  is  applicable  to  any 
of  the  above  applications. 

W  ith  this  approach  there  are  a  number  of  suitable  instruments  with  low  SW  AP  that  obtain  in-situ 
ionospheric  parameters  (we  restrict  ourselves  to  in-situ  measurements  for  this  study,  although  a 
similar  methodology  may  he  used  with  remote  measurements).  The  MESA  (Miniaturized 
Electrostatic  Analyzer)  instrument  [Enhe  et  al  2002]  is  a  bandpass  or  high-pass  energy  filter  (in 
either  of  two  configurations).  The  instrument  thus  measures  ion  or  electron  spectra  (convolved 
with  the  instrument  response  function)  from  which  plasma  density  and  temperature  can  be 
derived,  MESAs  have  flown  on  M1SSE-6,  MISSE-7  [Jenkins  et  al,  2009],  ANDE-2, 
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Fa  I  con  SAT- 5,  STP-H4  and  S  TP  Sat-3,  and  are  rostered  to  fly  on  OTB  and  other  missions. 
Another  instrument  of  interest  is  WINGS  (Winds  Ions  Neutrals  Composition  Suite)  and  its  sister 
instrument  SWATS  (Small  Wind  And  Temperature  Spectrometer),  developed  by  the  Naval 
Research  Laboratory.  W1NCS  and  SWATS  are  sensor  suites  measuring  ion  and  neutral  winds, 
temperature  and  composition  f http://wvwmrLnavv.miI/ssd/branches/7630/S WATS).  More 

generic/traditional  Langmuir  probes  and  Retarding  Potential  Analyzers  are  also  instruments  that 
may  with  care  be  integrated  into  a  low  SWAP  package  (although  the  standoff  length  of  a 
Langmuir  probe  may  prove  to  be  challenging). 


4.  GAIM-FP  Comparison  Methodology 

At  Utah  State  University,  we  have  developed  two  physics-based  Kalman-filter  data  assimilation 
models  for  the  Earth  Ionosphere.  The  two  models  are  the  Gauss- Markov  Kalman  Filter  Model 
(GAIM-GM)  and  the  Full  Physics- Based  Kalman  Filter  Model  (GAIM-FP)  [Sc  her  Hess  et  a 
2006,  2009)3-  Both  models  are  part  of  the  Global  Assimilation  of  Ionospheric  Measurements 
(GAIM)  project  [Schunk  et  ai  2004)  ♦  Some  of  the  data  that  we  have  previously  assimilated  in 
our  data  assimilation  models  include  in-situ  electron  density  measurements  from  DMSP 
satellites,  bottomside  electron  density  profiles  from  ionosondes,  GPS -TEC  data  from  a  network 
of  up  to  1000  ground  stations,  ultraviolet  (UV)  radiances  from  the  SSUSI  (Special  Sensor 
Ultraviolet  Spectrographic  Imager),  SSULI  (Special  Sensor  Ultraviolet  Limb  Imager),  and 
LORAAS  (Low  Resolution  Airglow  and  Aurora  Spectrograph)  instruments,  and  radio 
occupation  data  from  CHAMP  (Challenging  Minisatellite  Payload)  andSAC-C  (Satellite  de 
Aplicaciones  Cientiflcas-C)  (Hajj  et  al,  2004 )1QX  (Ionospheric  Occupation  Experiment)  {Straus 
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et  aL  2003).  and  the  COSMIC  (Constellation  Observing  System  for  Meteorology,  Ionosphere 
and  Climate)  {Roc ken  et  ai ,  2000)  satellite. 

The  Full  Phvsies-Based  Kalman  filter  model  is  based  on  an  ensemble  Kalman  filter  approach 
(Evensem  2003)  and  rigorously  evolves  the  ionosphere  and  plasmasphere  electron  density  field 
and  its  associated  errors  using  a  physics-based  I ono sphere- Plasmasphere  model  (I PM)  [Schunk  et 
ai,  2004,  2005;  Scherliess  et  ai,  2004].  The  IPM  is  based  on  a  numerical  solution  of  the  ion  and 
electron  continuity  and  momentum  equations  and  covers  the  low  and  mid-latitudes  from  90  to 
30,000  km  altitude*  In  its  current  version,  the  model  excludes  geomagnetic  latitudes  poleward  of 
s  ±60°  geomagnetic  latitude  due  to  the  vastly  different  physical  processes  that  govern  the  high- 
latitude  regions,  e*g,  convection  electric  fields,  particle  precipitation,  etc*  The  Full  Physics-Based 
data  assimilation  model  provides  specifications  on  a  spatial  grid  that  can  be  global,  regional,  or 
local  and  its  output  includes  the  3-dimensional  electron  and  ion  (NO1,  02+,  N2+,  O”,  H4,  He4) 
density  distributions  from  90  km  to  geosynchronous  altitude  (30,000  km).  In  addition,  the  model 
provides  the  global  distribution  of  the  ionospheric  drivers  (electric  field,  neutral  wind,  and 
composition)  that  are  consistent  with  the  ionospheric  observations*  It  is  important  to  note  that 
the  estimation  of  the  ionospheric  drivers  is  an  integral  part  of  our  ensemble  Kalman  filter  and  is 
achieved  by  using  the  internal  physics-based  model  sensitivities  to  the  various  driving  forces.  In 
this  procedure,  the  ionospheric  data  are  used  to  adjust  the  plasma  densities  and  its  drivers  so  that 
a  consistency  between  the  observations  (within  their  errors)  and  the  physical  model  is  achieved. 
As  a  result  the  assimilation  procedure  produces  the  optimal  model-data  combination  of  the 
lonosphere-plasmasphere  system  with  its  self-consistent  drivers  (electric  fields  and  neutral  winds 
and  composition)  [Scherfiess  et  ai ,  2009,  201 1]. 
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5 A  Kalman  Filter  Simulations 


The  Full  Physics-Based  data  assimilation  model  was  designed  to  specify  ionospheric  weather, 
but  the  model  can  also  be  used  to  study  the  sensitivity  of  the  specification  accuracy  on  different 
arrangements  of  observation  platforms  and  observation  geometries  and  can  provide  important 
information  for  the  planning  of  future  missions  [Atlas,  1997;  Atlas  et  al,  1985].  For  the  current 
study  this  latter  mode  has  been  used  and  simulation  experiments  have  been  performed,  fn  this 
mode  the  model  uses  a  Data  Simulation  System  Experiment  (OSSE)  using  two  different 
synthetic  (model-generated)  data  types:  slant  TEC  from  ground-based  GPS  stations  and  in-situ 
plasma  density  measurements  obtained  from  electrostatic  analyzers  (ESA)  onboard  of  a 
constellation  of  small  satellites.  Figure  1  shows  the  geographical  distribution  of  ground  GPS- 
TEC  stations  chosen  for  this  study.  In  the  OSSE,  the  simulated  weather  (true)  time-dependent  ion 
and  electron  density  distributions  are  generated  by  using  again  the  IPM  model.  For  this  study  we 
have  used  two  geo  magnetically  quiet  days,  2010  day  73  and  74  (March  1 4th/ 15th)  where  Kp-l 
throughout  the  two  days.  These  two  days  were  chosen  to  assist  in  another  study  comparing 
actual  MESA  data  from  the  MISSE7  experiment  on  the  ISS  with  the  GAIM  predictions;  that 
work  is  outside  the  scope  of  this  paper.  For  the  simulations  we  varied  the  equatorial  vertical  drift 
and  horizontal  neutral  winds  by  superposing  on  the  climatology  values  a  random  component. 
Note  that  neither  the  climatological  values  nor  the  random  components  are  known  to  the 
ensemble  Kalman  filter  part.  The  synthetic  data  were  then  generated  by  probing  the  3-D,  time- 
dependent  electron  density  distribution  for  the  weather  (true)  simulation  exactly  the  same  way 
the  real  instruments  probe  the  real  ionosphere.  For  the  GPS  receivers,  slant  TEC  values  were 
generated  only  for  elevation  angles  greater  than  15°.  For  the  in-situ  electron  densities  synthetic 
observations  were  generated  in  1 0-sec  increments.  When  the  synthetic  data  were  generated,  noise 
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was  added  to  each  ^measurement*  ’  in  order  to  mimic  a  real  observation.  A  5  TEC  unit  (TECU) 
level  of  noise  was  added  to  all  simulated  TEC  measurements  and  a  10%  uncertainty  to  the 
simulated  in-situ  measurements.  .  It  should  be  noted  that  the  10  second  resolution  of  the 
observations  is  not  intended  to  capture  variations  that  occur  on  this  small  time  step,  but  instead  to 
capture  spatial  variations  of  the  order  of  about  100-150  km  around  the  latitudinal  resolution  of 
the  model.  10  seconds  is  also  the  nominal  cadence  of  data-taking  in  the  l MESA  instrument 
(although  it  is  capable  of  running  as  fast  as  2Hz).  The  satellites  traverse  a  distance  of  about  70 
km  in  10  seconds,  which  provides  about  two  observations  per  latitude  grid  cell.  The  model  time 
step  of  15  minutes  was  chosen  to  capture  typical  variations  in  the  ionospheric  F-region  where  the 
characteristic  timescales  are  of  the  order  of  tens  of  minutes. 


The  ensemble  Kalman  filter  assimilation  procedure  was  implemented  as  follows.  At  0000  UT  on 
day  2010/073  the  plasma  distribution  obtained  from  the  “truth*'  run  (the  1PM  run  with  the 
modified  climatological  neutral  wind  and  equatorial  electric  field  Input)  was  taken  to  be  the 
initial  distribution  at  the  start  of  the  assimilation.  Every  15  min,  the  evolving  weather  simulation 
was  probed  to  obtain  the  two  synthetic  data  types  (with  noise)  as  described  above.  At  these  time 
marks  the  ensemble  of  ionosp here/plasm asph ere  model  runs  was  also  integrated  forward  in  time, 
and  the  model  error  covariance  matrix  was  determined  [Scherliess  et  ah,  2007].  Using  the  new 
data  and  the  new  error  matrix,  the  ensemble  Kalman  filter  reconstructed  an  updated  estimate  of 
the  plasma  distribution  and  its  drivers.  The  new  drift  and  wind  velocities  were  fed  back  into  the 
I  PM  and  the  assimilation  was  repeated  at  the  next  15  min  time  mark.  As  time  advanced,  the 
ensemble  Kalman  filter  produced  a  3-D,  time-dependent,  plasma  distribution  that  got  closer  and 
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closer  to  the  True*  plasma  distribution  associated  with  our  weather  simulation 

To  qualitatively  and  quantitatively  assess  the  impact  of  the  MFSA  observations  on  the  plasma 
specifications  four  ensemble  Kalman  filter  simulations  were  performed  Initially,  the  GA1M-FP 
model  assimilated  only  the  simulated  global  TEC  data  to  obtain  a  specification  of  the  plasma 
density  for  the  two  days.  This  model  simulation  is  referred  to  as  the  "ionospheric  specification'5 
and  may  be  compared  with  the  ""truth"  measurement  to  determine  the  accuracy  of  the  data 
assimilation  model. 

Next,  the  synthetic  MESA  “observation”  including  an  observational  uncertainty,  were 
assimilated  together  with  the  synthetic  global  TEC  data  to  simulate  data-taking  from  satellite 
constellations  that  did  not,  in  reality,  exist  at  that  particular  time.  The  simulated  observations 
were  taken  along  satellite  tracks  for  three  different  orbital  scenarios  at  10  second  simulated 
cadenceThe  orbital  scenarios  were  chosen  to  give  both  low-cost  (single  launch)  rapid  re¬ 
coverage  of  a  localized  area,  and  higher-cost  {multiple  launches)  global  coverage.  We  also 
wished  to  investigate  effect  of  varying  the  altitude  of  the  satellites  on  the  sensitivity  of  the 
specification.  Accordingly,  the  three  orbital  scenarios  chosen  were  as  follows: 

Scenario  A:  Ten  satellites  in  a  circular  500  km  polar  orbit  (90°  inclination)  at  longitude 
161.25°  E  (the  Pacific  sector,  where  GPS  TEC  ground  stations  are  relatively  sparse  compared 
to  over  continental  land  masses).  Small  (deliberate)  variations  in  the  satellite  surface 
treatment  will  lead  to  small  variations  in  satellite  drag,  causing  the  satellites  to  distribute 
themselves  along  the  orbital  path  until  they  are  spread  evenly  along  the  orbit.  This  represents 
the  “string  of  pearls”  configuration  for  a  single  launch/deployment. 
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Scenario  B:  As  scenario  A*  but  at  a  350  km  altitude* 


Scenario  C:  A  25/5/1  Walker  constellation  at  510  km  altitude  and  60°  inclination*  The 
Walker  constellation  notation  of  t/p/f  designates  /  satellites  arranged  over  p  evenly  spaced 
orbital  planes  {circular  orbits)  with / relative  spacing  between  satellites  in  adjacent  planes* 
Thus,  a  25/5/1  constellation  has  25  satellites,  five  satellites  per  orbital  plane.  We  have  picked 
a  nominal  relative  spacing  in  this  instance*  This  would  generally  require  five  launch  vehicles, 
each  deploying  five  satellites,  with  each  group  deploying  into  the  string  of  pearls 
configuration  after  some  weeks.  Figure  2  shows  (lower  panel)  Ne  at  510  km,  and  (upper 
panel)  the  ground  tracks  of  a  25/5/1  Walker  constellation  with  the  color  scale  along  each 
ground  track  demonstrating  the  sampling  of  Ne. 

For  each  of  the  three  orbital  scenarios  the  GAIM-FP  model  was  used  together  with  the  global 
TEC  inputs  and  the  MESA  “observation”  to  obtain  another  set  of  specifications  of  the  same  day. 
These  model  simulations  are  referred  to  as  the  “improved  ionospheric  specification”  and  may  be 
compared  to  the  original  “ionospheric  specification”  (without  any  MESA  data  inputs)  and  the 
original  “truth”  model  run. 

5.  Results 

For  Scenarios  A  and  B,  we  have  examined  a  vertical  slice  of  the  ionosphere  from  100  km  to  600 
krn  along  the  161.  25°  E  line  of  longitude  of  the  orbital  plane,  stretching  from  60°  N  to  60°  S* 
(Plots  are  plotted  to  the  poles,  but  the  GA1M  model  used  only  extends  to  +/-60*  magnetic 
latitude)*  Figure  3  shows  the  deviation  from  “truth”  in  units  of  ANe  (cm  3)  for  three  simulation 
runs:  “ionospheric  specification”  using  only  GPS -TEC  inputs  to  the  assimilative  forecast  model 
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(left  panel),  “improved  ionospheric  specification”  using  GPS-TEC  inputs  plus  inputs  from 
satellites  in  scenario  A  (center  panel)  (satellites  at  500  km),  and  “improved  ionospheric 
specification5’  using  GPS-TEC  inputs  plus  inputs  from  satellites  in  scenario  B  (right  panel) 
(satellites  at  350  km). 

A  visual  inspection  of  the  data  shows  that  utilizing  inputs  from  a  modest  constellation  of  ten 
satellites  at  either  of  two  altitudes  shows  a  distinct  improvement  to  the  “improved  ionospheric 
specification”  (ANe  converges  towards  zero).  What  is  perhaps  remarkable  is  that  the 
improvement  is  distinct  at  most  latitudes  and  can  be  seen  at  all  altitudes  and  not  just  at  the  orbital 
altitude.  The  apparent  propagation  of  information  to  other  altitude  regimes  is  a  manifestation  of 
the  strong  correlation  of  electron  density  variations  along  geomagnetic  field  lines.  These 
correlations  are  part  of  the  ensemble  Kalman  filter  and  automatically  calculated  using  the 
ensemble  of  physics-based  model  runs. This  indicates  that  the  useful  life  of  such  a  constellation, 
as  orbital  drag  decays  the  orbit  from  the  initial  insertion,  will  be  extended  through  the  life  of  the 
mission  (months  to  years  for  higher  initial  orbital  insertions),  rather  than  losing  their  use  after 
initial  orbital  decay. 

Scenario  C  allows  inspection  of  global  (latitude-longitude)  coverage.  We  have  elected  to  use 
hmF2  as  a  proxy  for  our  knowledge  of  the  ionosphere  (remembering  that  although  the  satellites 
in  Scenario  C  are  at  500  km,  the  earlier  results  indicate  that  information  is  apparently 
propagating  vertically  (owing  to  the  correlation  of  electron  density  along  magnetic  field  lines  in 
the  ensemble  Kalman  filter)  allowing  us  to  inspect  the  ionosphere  and  the  improvement  to  the 
plasma  specifications  at  any  altitude).  We  inspect  hmF2  at  an  arbitrary  time  of  1600  GMT  on 
day  2.  Figure  4  shows  hniF2  from  the  “truth”  model  (plotted  to  the  latitude  limits  of  the  model) 
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at  the  selected  lime.  Figure  5  shows  hmF2  obtained  from  the  "ionospheric  specification"  model 
using  only  GPS-TEC  inputs  to  the  model.  A  visual  inspection  shows  that  there  are  deviations 
from  "truth".  In  particular,  the  height  enhancement  over  the  Japanese  sector  is  not  found;  there 
is  an  erroneous  equatorial  plume  forecast  over  the  Indonesian  sector;  and  the  pronounced 
equatorial  anomaly  over  the  South  American  sector  is  not  seen  in  the  data  assimilation  results  for 
this  limited  model  run. 

Figure  6  shows  hmF2  obtained  from  the  "improved  ionospheric  specification  ,  utilizing  GPS- 
TEC  inputs  plus  simulated  data  from  the  MESA  instruments  in  the  Walker  constellation  of 
scenario  C.  Inspection  shows  that  the  three  features  mentioned  above,  reproduced  poorly  by  the 
"ionospheric  specification",  are  present  in  the  “improved  ionospheric  specification  . 

The  previous  examples  are  qualitative.  There  are  many  quantitative  metrics  that  can  be  used  to 
quantify  the  improvement,  and  we  have  arbitrarily  selected  two  metrics,  the  RMS  deviation 
(global  sum)  and  the  Skill  Score  (global  sum).  The  RMS  deviation,  summed  over  all  latitude- 
longitude  points  at  each  hmF2  altitude,  is  given  by  the  sum  of  the  squares  of  the  deviations  from 
truth  divided  by  the  number  of  observations  and  is  measured  in  km  (equation  1).  Improved 
modeling  will  reduce  the  RMS  deviation  towards  zero. 


The  Skill  Score  is  a  measure  of  improvement  of  one  model  over  another  and  is  unitless,  ranging 
from  —  infinity  to  +1.  If  the  second  model  is  perfect  the  Skill  Score  tends  to  +1,  and  if  the  second 
model  predicts  no  better  than  random  chance  the  Skill  Score  tends  towards  0  (equation  2). 


RMS  = 
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Skill  Score  =  1  - 


£  (Truth  -  ( C  P$+ 1 MESA)  )2 
£( Truth-GPS  only)3 


Figure  7  shows  the  RMS  deviation  from  truth  global  sum  over  a  24 -hour  period  on  2010  day 
073.  With  the  “ionospheric  specification”  (GPS-TEC  only),  the  RMS  deviation  from  truth 
varies  between  25  km  and  100  km  over  the  course  of  the  24  hours,  ft  is  interesting  to  note  the 
variation  over  time,  and  we  suggest  that  this  is  due  a  function  of  daytime  and  nighttime  regions 
being  densely  or  less  densely  populated  with  GPS-TEC  ground  stations,  as  the  sun  moves  from 
the  Pacific  sector  (less  densely  populated  with  GPS-TEC  ground  stations)  to  the  American  and 
European  sectors  (more  densely  populated).  With  the  “improved  ionospheric  specification” 
{GPS-TEC  plus  simulated  MESA  data  from  scenario  C),  which  of  course  are  agnostic  to  day- 
night  variations,  the  RMS  deviation  global  sum  improves  to  around  10  km  over  the  course  of  the 
day. 


The  Skill  Score  comparison  of  the  two  model  runs  is  shown  in  Figure  8.  Again  we  see  a 
pronounced  diurnal  response,  with  the  “improved  ionospheric  specification”  performing 
extremely  well  in  the  0000  UT  to  0600  UT,  and  1800  UT  to  2359  UT  timeframes,  and 
m  argi  n  al  1  y  1  ess  we  1 1  between  those  t  i  m  efram  e  s .  However,  w  ith  the  Skill  S  core  minimum  be  i  ng 
-0.75,  we  can  conclude  that  overall  there  is  a  marked  improvement  to  our  forecast  model  with  25 
MESAs  in  orbital  scenario  C. 


We  recognize  that  the  results  obtained  from  these  metrics  can  depend  on  other  parameters  such 
as  geomagnetic  activity,  but  such  an  investigation  is  outside  the  bounds  of  this  paper. 


6.  Conclusions 
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We  have  proposed  using  a  simple  sensor  that  measures  ion  and  electron  energy  spectra,  from 
which  plasma  density  and  temperature  can  be  derived,  in  a  low-cost  mission  of  small 
satellites/sensors,  A  full  physics  ionospheric  model  has  been  utilized  to  derive  "truth  data.  The 
GAIM-FP  forecast  model  has  then  been  run  both  without  and  with  simulated  sensor  data  inputs. 
Our  model  simulations  have  shown  that  adding  a  constellation  of  small  satellites/sensors  in 
addition  to  global  TEC  inputs  converges  the  GAIM-FP  model  closer  to  "truth"  in  the  situations 
we  describe.  For  a  real-life  mission  for  which  a  launch  has  not  been  imposed,  a  desired 
improvement  metric  may  be  selected  and  thus  orbital  parameters  can  be  fine-tuned  to  optimize 
the  model  improvement  for  the  metric  of  interest..  What  is  particularly  interesting  is  that  the 
model  is  improved  over  a  range  of  altitudes,  not  just  at  and  around  the  sateilite/sensor  altitude, 
emphasizing  the  coupled  nature  of  both  the  model  and  reality,  (and  In  particular  here,  the  strong 
correlation  of  electron  density  along  geomagnetic  field  lines  in  both  the  model  and  reality).  Put 
another  way,  knowledge  at  one  location  leads  to  improved  knowledge  at  other  locations. 

However,  what  has  become  apparent  is  the  challenge  to  develop  a  generally  agreed  metric  or  set 
of  metrics  to  measure  the  scientific  and  operational  benefit  to  assimilative  models  from  the  use 
of  multiple  small  satellite/sensor  inputs. 

7.  Acknowledgements 

The  authors  wish  to  thank  the  Air  Force  Office  of  Scientific  Research  tor  their  support. 

The  work  at  Utah  State  University  was  partially  supported  by  NSF  grant  AGS-1329S44. 

The  GAIM-FP  data  is  publically  available  on  request  from  USU,  POC  Ludger  Scherliess, 
ludaer.scherHess@usu.edu 


316 


317 


8,  References 


318  Anderson.  B.  J.,  Takahashi.  K...  Kamei,  T„  Waters,  C.  L„  &  Toth,  B.  A.  (2002).  Birkeland 

319  current  system  key  parameters  derived  from  Iridium  observations:  Method  and  initial  validation 

320  results.  Journal  of  Geophysical  Research:  Space  Physics  (1978-2012),  )0/(A6),  SM1M 1. 

321  Atlas,  Robert  (1997)  Atmospheric  observations  and  experiments  to  assess  their  usefulness  in  data 

322  assimilation,  JMSJ,  Vol.  75,  pp.  1 1 1-130, 

323  Atlas,  R.,  E.  Kalnay,  J.  Susskind,  W.  E.  Baker  and  ML  Haiem  (1985):  Simulation  studies  of  the 

324  impact  of  future  observing  systems  on  weather  prediction.  Proc.  Seventh  Conf.  on  NWP.  145- 

325  151. 

326  Barnhart,  D.  J.,  T.  Vladimirova,  M.  N.  Sweeting,  R.  L.  Balthazor,  C.  L,  bnloe,  L.  H.  Krause,  T. 

327  J.  Lawrence,  M.  G.  Mcharg,  J.  C.  Lyke,  J.  J.  White,  and  A.  M.  Baker  (2007),  Enabling  Space 

328  Sensor  Networks  with  PCBSat,  AIAA  Paper  SSC07-IV-4 

329  Barnhart,  D.  J.,  T.  Vladimirova,  and  M.  N.  Sweeting,  (2007),  Very  Small  Satellite  Design  for 

330  Distributed  Space  Missions,  Journal  of  Spacecraft  and  Rockets,  Voi.  44,  No.  6,  pp.  1294-1306. 

331  Barnhart,  D.  J.  (2008),  Very  Small  Satellites  Design  for  Space  Sensor  Networks.  Ph.D.  Diesis, 

332  Univ.  of  Surrey,  Guildford,  England,  U.K.,  http://handle.dtic.miI/100.2/ADA486188 

333  Barnhart,  DJ,  T.  Vladimirova  and  M.N.  Sweeting  (2009),  Satellite  Miniaturization  Techniques 

334  for  Space  Sensor  Networks,  Journal  of  Spacecraft  and  Rockets,  Vol  46,  No.  2,  doi 


335 


10.2514/1.41639 


336  Daley,  R.  (1991),  Atmospheric  Data  Analysis,  Cambridge  University  Press,  Cambridge,  UK 

337  De  la  Beaujardiere,  O.  (2004),  C/NOFS:  a  Mission  to  Forecast  Scintillations,  Journal  of 

338  Atmospheric  and  Solar-Terrestrial  Physics.  Voi.  66,  No.  1 7,  pp.  1573-1591 

33S 

340  Dyrud,  L.  P„  1  entzke,  J.  1 Cahoy,  K.,  Murphy,  S.,  Wiscombe,  W„  Fish,  C.,  Gunter,  B.,  Bishop, 

341  R„  Bust,  G„  Erlandson,  R.,  Bauer,  B„  &  Gupta,  O.  (2012),  GEOScan:  a  geoscience  facility  from 

342  space.  In  SPIE  Defense,  Security,  and  Sensing  (pp.  83850 V-83850V).  International  Society  for 

343  Optics  and  Photonics. 

344 

345  Enloe,  C.  L.,  J.  Lloyd,  S.  Meassick,  C.  Chan,  J.  O.  McGarity,  A.  Huber,  and  P.  Hartnett  (1995), 

346  Compact  Thermal  Ion  Detector  for  Space  and  Laboratory  Applications,  Review  of  Scientific 

347  Instruments  66.8,  4174-719Enloe,  C.  L.,  L.  Habash  Krause,  R.  K.  Haaland,  T.  T.  Patterson,  C.  E. 

348  Richardson,  C.  C.  La/.idis,  and  R.  G.  Whiting  (2002),  Miniaturized  electrostatic  analyzer 

349  manufactured  using  photolithographic  etching,  Review  of  Scientific  Instruments  74:3,  DOl: 

350  10.1063/1.1540715 

351 

352  Evensen,  G.  (2003),  The  Ensemble  Kalman  Filter:  Theoretical  Formulation  and  Practical 

353  Implementation,  Ocean  Dynamics,  53, 343-367,  DOl  10. 1 007/s  10236-003-0036-9. 


354 

355 

356 

357 

353 

359 

360 

361 

362 

363 

364 

365 

366 

367 

36S 

369 

370 

371 

372 


Hajj,  G.  A.,  C,  O.  Aof  B.  A,  lijima,  D+  Kuang,  E.  R.  Kursinski,  A,  J,  Mannuccf  T.  K.  Meehan,  L. 
J.  Romans.  M.  de  la  Torre  Juarez,  and  T.  P.  Yunck  (2004) r  CHAMP  and  SAC-C  atmospheric 
occultation  results  and  intercom  pari  sons,  J.  Geophys.  Re$r.  109,  DQ61Q9. 
doi  KM  029/2003 JD0039Q9. 

Kalman,  A+,  A.  Reif,  D.  Berkenstock,  J.  Mann  and  J,  Cutler  (2008),  MISC  -  A  Novel  Approach 
to  Low-Cost  Imaging  Satellites,  Proceedings  of  the  22nd  Annual  Conference  On  Small  Satellites 

Jenkins,  P.;  RJ.  Walters,  M.  J.  Krasowski,  J.  J+  Chapman,  P.  G.  Ballard,  J-  A,  Vasquez,  D,  R. 
Mahoney,  S.  R  LaCava,  W.  R.  Braun,  N.  F+  Prokop,  J.  M+  Flatico,  L.  C.  Greer,  K.  B.  Gibson, 
WJ-L  Kinard,  and  H.  G.  Pippin  (2009),  M1SSE-7:  Building  a  Permanent  Environmental  Testbed 
for  the  International  Space  Station,  Proceedings  of  the  9th  International  Space  Conference 
Protection  of  Materials  and  Structures  From  Space  Environment,  Toronto,  Canada,  19-23  May 
2008,  Ed.  JJ.  Kleinian,  AiP  Conference  Proceedings  1087,  pp.  273-276 

Kalman,  A,  Reif,  and  J.  Martin  (2013),  MISC  3  -  The  next  generation  of  3U  CubeSats, 
Proceedings  of  the  CubeSat  Developers  Summer  Workshop 

Rocken,  C.,  YTL  You,  W,S.  Schreiner,  D,  Hunt,  S.  Sokolovskiy,  and  C  McCormick  (2000), 
COSMIC  system  description,  Terrestrial  Atmospheric  and  Oceanic  Sciences*  / /,  L  pp  21-52 

Seheriiess,  L*,  R+W.  Schunk,  JJ.  Sojka,  and  D+  Thompson  (2004),  Development  of  a  Physics- 
Based  Reduced  State  Kalman  Filter  for  the  Ionosphere,  Radio  Set ,  39,  RS 1 S04, 


do  i :  1 0 . 1 02 9/2 002R  S002 797, 


373  Seherliess,  L.  D.  Thompson,  R.W*  Sehunk,  and  J.i.  Sojka  (2006),  lonospheric/thermospheric 

374  variability  at  middle  latitudes  obtained  from  the  global  assimilation  ofionospherie  measurements 

375  (G A 1 M )  model ,  Eos  Trans,  AGUt  8 7(5 2) ,  Fal  1  Meet.  S u ppl . ,  A bstract  S A 1 2  A-0 3 . 

376  Seherliess,  L.,  D.C.  Thompson,  and  R.W.  Sehunk  (2009).  ionospheric  dynamics  and  drivers 

377  obtained  from  a  physics-based  data  assimilation  model,  Radio  Science,  44,  RS0A32*  doi: 

378  10.  I029/2GO8RSOQ4O68. 

379  Seherliess,  L,,  D*C  Thompson,  and  R.W.  Sehunk  (2011),  Data  assimilation  models:  A  'new' 

380  tool  for  ionosphere  science  and  applications,  in  The  Dynamic  Magnetosphere ,  Springer,  doi 

381  1 0. 1 007/978-94-007-050 1  “21 8 

382  Sehunk,  R.W.,  L.  Seherliess*  JJ*  Sojka,  and  D.  Thompson  (2004),  Global  Assimilation  of 

383  Ionospheric  Measurements  (GAIM),  Radio  Set,  39,  RS 1  $02,  doi:  1 0* 1 0 29/2002 RS0027 94, 

384  Sehunk,  R.W,.  L.  Seherliess,  J.J.  Sojka,  D.  Thompson,  and  L.  Zhu  (2005),  Ionospheric  Weather 

385  Forecasting  on  the  Horizon*  Space  Weather ,  3,  S080G7,  doi:10JQ29/2004SW000138* 

386  Seo,  J  (2010),  Overcoming  Ionospheric  Scintillation  for  Worldwide  GPS  Aviation*  PhD  thesis, 

387  Stanford  University,  CA 

388  Straus,  P.  R.?  P.  C.  Anderson,  and  J*  E*  Danaher  (2003),  GPS  occultation  sensor  observations  of 

389  ionospheric  scintillation,  Geophys.  Res.  Lett.,  30*  1436*  doi:  1 0*1 029/2002GLO 16503,  8. 

390  Vladimirova,  T.,  M  P.  Bannister,  J.  Fothergill,  G.  W *  Fraser,  M.  Lester,  D.  M.  Wright,  M.  J. 

391  Pont,  D.  J.  Barnhart,  O.  Emam  (2011),  CubeSat  Mission  for  Space  Weather  Monitoring, 

392  Proceedings  of  11th  Australian  Space  Science  Conference,  ASSC1 1 ,  Canberra,  Australia. 


393 


394  Figures 

TEC  2010  073/12:00  En:  01 


396  Figure  !:  Geographical  distribution  of  ground-based  GPS-TEC  stations  chosen  for  this 

397  study.  The  figure  shows  the  500  km  pierce  points  of  observations  at  the  given  time 

398  (2010/073  1200  UT),  and  the  color  scale  depicts  vertical  TEC  with  blue  indicating  low  TEC 

399  and  red  indicating  high  TEC, 

400 

401 

402  . 

403 


404 


Edensity  @  510  km  2010  073/00:00 


0  60  120  180  240  300  360 

Longitude 


406  Figure  2:  (upper  panel)  25/5/1  Walker  constellation  ground  tracks  showing  sampling  of  Ne 

407  from  "truth TT  model  run  ,  and  (lower  panel)  snapshot  of  Ne  obtained  from  an  "improved 

4 OS  ionospheric  specification"  forecast  model  (GPS  TEC  and  sampled  MESA  data) 
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411  Figure  3:  Model  deviations  from  "truth"  run  for  scenarios  A  and  B,  over  the  altitude- 

412  latitude  slice  at  longitude  I6L25&E,  Changes  in  Ne  are  denoted  by  variations  in  the  color 

413  scale  from  green  (no  deviation). 
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Figure  4:  "Truth"  model  of  hmF2 


418  Figure  5:  hmF2  "ionospheric  specification"  model  of  hmF2  using  only  GPS-TEC  inputs  to 

419  the  GAIM-FP  model 
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422  Figure  6:  hitiF2  "improved  ionospheric  specif  cation"  model  of  hmF2  using  GPS-TEC  and 

423  in-situ  MESA  data 


424 


426  Figure  7:  RMS  deviation  of  hmF2  prediction  (global  sum).  The  upper  (dotted)  line  shows 

427  predictions  from  the  "ionospheric  specification"  (GPS-TEC  only);  the  lower  (solid)  plot 

428  shows  the  predictions  for  "improved  ionospheric  specification"  (GPS-TEC  and  MESA 

429  inputs). 
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432  Figure  8:  Skill  Score  of  hmF2  prediction,  comparing  11  improved  ionospheric  specification rt 

433  to  "ionospheric  specification". 
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